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ABSTRACT 

A procedure  for  constructing  one-error-correcling  and  two-error- 
detecting systematic  codes  has  been  introduced  by  R.W.  Hamming. 
Some  examples  of  n-error-correcting  and(n+l)  error -detecting 
systematic  codes  for  the  cases  where  both  the  code  length  and  n+1 
are  powers  of  two  are  presented.  The  decoding  scheme  presented 
in  this  repwrt  differs  from  Hamming's  scheme  in  that  the  encoded 
message  will  be  extracted  directly  from  the  possibly  corrupted  re- 
ceived code  by  a majority  testing  of  the  redundant  relations  within 
the  code.  The  general  multinomial  expansion  formula  for  a Boolean 
function  is  discussed.  A theorem  about  the  relations  satisfied  by  the 
highest  or  r-th  degree  coefficient  of  any  vector  or  polynomial  of  a 
defined  submodule  of  a particular  Boolean  ring  is  proved,  and  forms 
the  basis  for  the  general  decoding  principle. 
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A CLASS  OF  MULTIPLE-ERROR-CORRECTING  CODES  AND  THE  DECODING  SCHEME 

I.  INTRODUCTION 

A procedure  for  constructing  one-error-correcting  and  two-error-detecting  system- 
atic codes  was  introduced  in  a recent  study  by  R.  W.  Hamming.  ^ It  is  the  purpose  of  this  report 
to  exhibit  some  examples  of  n-error-correcting  and  (n  + 1)  error-detecting  systematic  codes 
for  the  cases  where  both  the  code  length  and  (n  + 1)  are  powers  of  two.  The  class  of  codes  to  be 
considered  was  developed  by  D.  E.  Muller  in  his  recent  work.^ 

The  decoding  scheme  presented  in  this  report  differs  from  Hamming's  scheme  in 
that  the  encoded  message  will  be  extracted  directly  from  the  possibly  corrupted  received  code 
by  a majority  testing  of  the  redundant  relations  within  the  code.  Hamming's  scheme  for  n = 1 
was  dependent  first  on  the  location  of  a possible  digit  error  in  the  code;  secondly,  on  the  correc- 
tion of  that  digit;  and  lastly,  on  the  extraction  of  the  message  from  the  corrected  code.  By  cir- 
cumventing Hamming's  step  of  error  Icxiation  and  correction,  which  is  quite  a severe  problem 
when  n is  not  equal  to  one,  we  have  arrived  at  a decoding  scheme  that  makes  a natural  use  of 
the  redundancy  within  the  code  as  well  as  being  conceptually  simple  and  practical  to  implement. 

In  this  report,  some  of  the  mathematical  proofs  of  the  methods  discussed  will  be 
avoided  for  the  sake  of  brevity  of  exposition.  A more  detailed  mathematical  analysis  will  appear 
elsewhere. 

II.  SOME  MATHEMAITCAL  PRELIMINARIES 

A ctxie  having  n binary  digits  may  be  considered  the  clement  of  a space,  consisting 
of  2*^  elements  of  the  form 

where 

(L  = 0,  1)  for  (j  = 0,  1 , 2,  . . . n - 1 ) 

This  space  is  technically  an  Abelian  group  if  the  sum  of  any  two  elements  f and  g in  the  space  is 
defined  as  follows: 

f©g=  (fo'fl■•••^,-l)®  (So-gr-'-g,,.,)  = fil'-"fn-l  ®Rn-l*  ’ 

where  f.  © g.  is  the  sum  modulo  two  of  the  binary  digits  f.  and  g for  (j  = 0,  1 , 2,  . . . n - 1 ).  If 

J J J J 

multiplication  by  the  binary  scalar  a is  allowed  as 

of  = a(fp.fj....f,^_j)  = (afo.afj,...af^_j)  . 

ttic  ^r*oup  trisy  be  tc**mcci  ^ vector  epoce  of  ri“dimensions  or  2.  rno'dule. 

Finally,  if  the  inner  product  operation 

f * g = (^0’  • • • ^n-1^  ' ®l’  • • • ®n-P  ■ ^^0^0'  ^1^1  ’ ‘ ‘ ^n- l^n-  1 ^ 

for  f and  g in  the  module  is  introduced,  the  space  is  a Boolean  ring.  The  prime  operation  is 
defined  to  be 

f = f © I 
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for  f in  the  ring,  and  where  I is  the  identity  vector  (1,  1,  1,  . . . 1). 

Into  this  space  one  may  further  introduce  a norm  or  length  of  a vector  as  follows: 


imi  = z f 

i=l 

where  E refers  to  ordinary  addition.  It  is  not  difficult  to  see  that  the  norm  of  the  sum  of  two 
elements  f and  g in  the  ring  or  Iff  © g||  is  precisely  the  Hamming  distance  D(f,  g)  as  defined 

in  Ref.  1. 

Now  let  n the  dimension  of  the  vector  space  be  a power  of  two  or  n = 2*^.  Let  a 
vector  of  this  space  be  of  the  form 


f = (f„, f,,  . . . f ) , 

0 1 ^m_j^ 

where  L is  a binary  digit  for  (j  = 0,  1,  . . . z"^-l).  Now  the  vector  f may  be  clearly  expressed  as 


f = f„I„  ® f.l,  ® ..  .f  ^ I 

0 0 11  2^^  1 2^^  1 


(!) 


where  1 is  a unit  vector  with  the  digit  one  in  j-th  coordinate  of  the  vector  and  zeros  elsewhere 
1 m 

for  (j  = 0,  1,  ...  2 -1).  Further,  each  unit  vector  1^  can  be  determined  as  a product  of  m vectors 

from  the  set  of  2m  vectors  x , , x,,  x,,  . . . x . x'  x',,  x' , . . . x ' , where  x , is  a vector  consisting 

123ml23m  1 

of  alternating  zeros  and  ones,  beginning  with  zero;  x^  is  a vector  consisting  of  alternating  zero 
pairs  and  one  pairs,  beginning  with  a zero  pair,  and  so  forth,  as  follows: 


X J - (0  1 0 1 0 1 0 1 . . . 0 1) 

x^  (0  0 1 1 0 0 1 1 . . . 1 1) 

Xj  = (0  0 0 0 1 1 1 1 . . . 11) 


X =(0  0000000...  11) 


(2) 


If  x,^  is  defined  to  be  x*  for  i,^  = 0 and  x,  for  i.  = 1,  then  by  the  rules  of  Boolean  algebra, 


, *1  '2  ^m 

= *1  *2  •••’‘m 


where 


(3) 


k-1 

j = E i|^  2 with  (i|^  = 0,  1)  for  (j  = 0,  1,  . . . m - 1) 
k=  1 


Combining  Eqs.  (1)  and  (3).  we  have 

,m  ... 

. ^ 4 *2  !m 

f = 2 f . X,  . . . X 

j=0  J * ^ m 


(4) 


where  ij,  i-2, . . are  the  digits  of  the  binary  representation  of  j,  and  where  the  summation 
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sign  B is  with  respect  to  the  sum  operation  ©.  Equation  (4)  is  the  canonical  expansion  of  any 
vector  f in  the  Boolean  algebra  of  2”*  dimensional  vectors,  consisting  of  binary  digits. 

If  the  identity  xj  = I ® the  distributive  law  of  the  algebra  is  used,  Eq.  (4)  may 

lie  expanded  to  obtain  the  following  polynomial  in  the 

goOgi^'i®  •••  ® g^x^®  gl^x,X2®  ...g^.,_^x^.jx^©... 

••  ® Sl^...m’‘l’‘2•■  •’'m  • 

Equation  (5)  can  be  written  more  explicitly  as 


f = f(0 0)  ® A f(0,  . . . 0)  X,  © . . . © A f(0, 

1 m 


,0)  © A f(0,  ...  0)  XjX^ 


© . . . ® A f(0,  ...  0)  XjX^.  . . x^ 
12.  . . m 


(6) 


wh  c re 


f(», ■-  fj  when  j 


m 

1. 

k=l 


k-1 


for  1, 


0, 1 


and  the  A's  are  multiple  jiartial  differences,  for  example, 

A f(0)  = f(l,  0,  0,  . . . )0  f(0,  0.  0.  ...  0) 

1 

7 

A f(0)  = [f(l,  1.0 ) ® f(0,  1, 0,  . . . )1  © [ f(l,  0,  0 ) © f(0,  0,  0 )]  , 

12 

and  so  forth.  The  polynomial  representation  in  Eq.  (6)  of  the  vector  f supplies  the  relations 
between  the  coefficients  of  Eq.  (5)  and  the  scalars  E of  Eq.  (4)  for  (j  = 0,  1,  2,  . . . 2^-1).  This 
definition  of  the  A's  will  be  expanded  in  Sec.  V. 


III.  THE  GENERATION  OF  THE  MULTIPLE  ERROR  ALLOWING  CODES 

Suppose  that  the  dimension  of  the  space  considered  in  Sec.  II  is  2"^.  Consider  the 
set  of  all  polynomials  of  the  form  (5)  of  degree  less  than  or  equal  to  r where  r ^ m.  Each 
such  polynomial  must  have  the  form 


go  ® © • • 


© g X © . . . © gi  ■> 

^ m ^ ^ ^12. 


X . . 

r I 


. X ® . . . © g 


m-r,  m-r+1,  . 


X X , X 

m-r  m-r+1  m 


(7) 


and  the  sum  of  any  two  such  polynomials  is  a member  of  the  same  set.  This  implies  that 
the  set  of  all  polynomials  of  type  (7)  or  of  degree  less  than  or  equal  to  r forms  an  Abelian  group 
or  submodule  of  the  Boolean  ring  of  2"^  dimensional  vectors.  Since  (][)™  is  a module,  the 
Hamming  distance  between  any  two  elements  of  is  the  norm  of  a third  element  of  This 

fact  was  exploited  by  D.  E,  Muller^  in  proving  his  Theorem  25.  Muller's  Theorem  25,  in  our 
terminology,  may  be  expressed  as  follows: 
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Theorem  A:  — The  norms  of  all  non-zero  vectors  f of  satisfy 
||f||  ^ 2”'*'"  for  (m  = 0,  1,  2,  ...  ) and  r ^ m 

We  shall  not  prove  this  theorem  in  this  section.  It  suffices  to  say  that,  with  respect  to  our 
terminology,  Muller  proved  the  theorem  by  an  induction  on  m,  holding  m - r constant,  and  the 
properties  of  the  Hamming  distance. 

By  the  above  theorem  there  is  at  least  a distance  2*^  ^ between  two  elements  of 
and,  as  a consequence,  there  is  an  open  Hamming  sphere  of  radius  2*^  ''  * about  each  element 
of  in  (the  whole  vector  space)  which  does  not  intersect  any  other  such  sphere.  This 
means  that  it  is  possible  to  associate  each  element  of  such  a sphere  with  the  element  defining 
the  sphere  or  what  is  the  same  to  associate  an  element  of  which  is  less  than  a distance 
2"^  *■  1 from  an  element  f of  with  f. 

In  order  to  illustrate  how  a message  may  be  coded  into  an  error-detecting  code  of 
the  type  described  above,  consider  the  following  example:  Let  m = 4 and  r = 1,  by  (7)  the 

vectors  of  are  of  the  form 

g(j  © g,Xi  © g^x^  © g3X^  © g^X4  (8) 

Let  the  message  consist  of  the  five  binary  digits  (g^,  gj,  g^.  gj.  g^).  The  code  space  may  be 
regarded  as  generated  by  the  four-  vector'  Xj,  x^,  x^  and  the  identity  vector  1 which  may  be 
written  explicitly  as  follows: 

X|  = (0  10101010101  0 101) 

x^MCOllOOllOOllOOll) 

Xj  : (0  0 0 0 1 1 1 I 0 0 0 0 1 1 1 1) 

x^  = (0  0 0 0 0 0 0 0 I 1 1 1 1 1 1 1) 

I = (1  1 I I 1 I 1 1 1 1 1 1 1 1 1 1)  . (9) 

The  32  vector  codes  of  can  be  obtained  by  scalar  multiplication  of  the  vectors  of  (9)  by  the 
message  digits  g^.  gj,  g^,  gj.  in  accordance  with  (8)  For  example,  the  message  (0  1 10  0) 
has  the  code  vector  g|Xj  © g2X^  or 

(0110  0 110  0 1 1 0 0 1 1 0) 

Each  of  tht  32  codes  will  be  a distance  of  at  least  eight  from  each  other. 

In  order  to  practically  generate  the  above  code,  one  should  note  that  the  vector  Xj 
is  the  sequence  of  digits  generated  by  the  least  significant  binary  stage  B|  of  a binary  counter 
of  scale  sixteen;  x^  is  obtained  from  the  second  stage  B^:  Xj  from  the  third  stage  B^;  and  x^ 
from  the  final  stage  B^,  as  the  counter  goes  through  one  period  of  its  operation.  If  the  message 
(S..i  2. ; 2 g-. ■ ' 'f*  stored  in  a binarv  recister  with  staees  A,^,A,,A,,A,,A,,  then  the  switching 

function 

C = A(,  © AjBj  © A^B^  © A3B3  © A^B^ 

will  generate  the  code  sequentially  during  one  period  of  operation  of  the  binary  counter. 
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If  one  of  the  above  codes  of  is  corrupted  during  transmission  so  that  no  more 
than  three  errors  are  made,  it  is  evidently  possible  by  the  previous  discussion  of  this  section 
to  somehow  extract  the  original  message  from  the  corrupted  received  code.  The  method  by 
which  this  extraction  may  be  accomplished  will  be  shown  by  example  in  the  next  section  and  in 
general  in  the  last  section.  It  should  be  clear  from  the  above  example  how  the  vectors  of 
may  be  generated  for  arbitrary  r and  m where  r ^ m. 

IV.  DECODING  CORRUPTED  CODES  OF  BY  A MAJORITY  TESTING 
OF  REDUNDANCY  RELATIONS 

Let  us  first  consider  the  coding  space  (|>j.  By  (7),  the  vector  of  this  space  lias 

the  form 

gQl  © g[X,  © ® B3X3  • (10) 

I'he  message  will  consist  of  the  four  binary  digits  (g^,  gj,  g^,  gj).  and  the  generating  vectors  of 
the  space  are 

Xj  --  (0  1 0 1 0 1 0 1) 

x^  = (0  1>  1 I 0 1 1) 

Xj  - {()  0 0 0 1 1 1 1) 

1 Ml  1 1 1 I 1 1 1)  ■ (11) 


By  (6)  wo  have  the  following  set  of  iclalions  for  the  message  digits  g in  tm  ins  of  f,  , the  code 

J ^ 

digit  s. 


f(0,  . . . 0)  = f. 


A f(0.  . . ) = f„  ® f,  © f,  © f. 


\J 

u 

1 i 

U i C.  3 

Kl 

A f(0.  . 
1 

.)=fo®f,  . 

S f(U.  . . 
13 

© 

© 

© 

= 

A f(0.  . 
1 

© 

0 

• 

A f(0.  . . 
J3 

) ^ fo  © © f4  © 0 , 

83  ■ 

A f(0.  . 
3 

. ) ^ fo  ® L • 

A f(0.  . . 
1J3 

7 

) : E f = 0 
i=U  ‘ 

(12) 

By  (IJ)  there  are  four  relations  which  gj  satisfies. 

gl  = © f,  - f^  © fy  ^ 14  © © fj  © f4  © f^  © f(,  © fy 

By  substituting  the  second  and  third  relations  into  the  fourth  relation,  we  have 

gM  61  © g[  © = ° © ‘'b  ® ^ ''b  ® ^7 


Thus  we  obtain  the  four  independent  and  dis.ioint  relations  for  g,, 

These  four  relations  are  disjoint  in  the  sense  that  no  two  of  the  relations  have  variables  in 
common.  In  a similar  manner,  we  may  obtain  four  independent  and  disjoint  relations  for  both 
and  gj  so  that  gj,  g^,  gj  may  be  expressed  as 
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gj  = fo®  = ^2  ® ^3  = ^4  ® ^5  = ^6  ® ^7  • 

®2  ” ^0  ® ^2  ■ ® ^3  ■ ^4  ® ^6  " ^5  ® ^7  • 

g3  = fo©f4  =f,©f5  = f2©f^=f3©f7  . 

Let  us  now  suppose  that  the  received  code  is  the  vector  (fQ,  fj,  . . . f^).  If  there  were 
no  error  in  transmission  of  the  code,  all  of  the  above  relations  would  hold.  If  there  were  one 
error,  three  out  of  four  of  the  relations  would  hold.  If  there  were  two  errors,  at  least  two  of 
the  gj's  would  have  two  out  of  four  incorrect  relations.  Then  gj,  g^,  g3  may  be  determined 
uniquely  if  one  or  no  error  occurred  during  transmission,  and  two  errors  may  always  be 
detected  by  making  a majority  decision  test  on  the  arithmetic  sum  of  the  values  of  the  four 
relations  for  each  g^  (j  = 1,  2.  3).  In  order  to  state  this  criterion  more  explicitly,  let  the  values 
of  the  four  relations  for  g^  be  denoted  by  r^j,  r^^"  '’j3'  ^j4  fo*"  (j  = 2.  3),  and  let  be  the  arith- 

metic sum  of  r r.,,  r...  r.  . or 
jl  j2'  j3  j4 

4 


Then  the  majority  decision  test  for  is 

g = 0 


if  0 < S <2 
J 


g.  is  indeterminate 


if  S = 2 
J 


g = 1 


if  2 < Sj  $ 4 for  (j  = 1,  2.  3) 


(13) 


With  the  assumption  that  the  received  code  is  no  more  than  two  digits  in  error, 
the  majority  test  (13)  will  determine  gj.g2-63  uniquely  for  only  one  or  no  errors,  and  reject 
the  code  as  meaningless  in  the  case  of  two  errors.  In  the  case  of  one  error  or  less,  gj,  g^,  g3 
may  be  assumed  now  to  be  determined;  it  remains  to  determine  g^.  In  order  to  find  g^,  note 
that  if,  as  gj,  g^,  g3  are  found,  the  vectors  gj^tj.  ^2^1'  ^3^3  added  successively  to  the 
received  vector,  by  (10)  we  will  end  with  either  the  vector  g^l  in  the  case  of  no  error  or  with  a 
vector  of  distance  one  from  gpl.  Thus  to  detect  gp  the  following  majority  decision  test  will 
suffice: 


go  = 0 if 


7 

Z m.  < 4 
i = 0 


7 

= 1 if  T m.  > 4 
i-0  ‘ 


(14) 


where  m^  are  the  digits  of  the  code  after  extraction  of  digits  gj,  Sj  in  accordance  with  the 
above  procedure. 

The  above  method  of  decoding  may  be  illustrated  by  the  following  example:  Suppose 
that  the  message  sent  was  (1  0 1 1),  and  that  during  transmission  an  error  was  made  in  the  fifth 
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digit  of  the  original  code  (1  1 0 0 0 0 1 1)  so  that  the  received  code  had  the  form  (1  10  0 10  11). 
We  fiist  test  for  gj,  g^.  gj  by  (12)  and  find  gj  = 0,  g^  = 1 and  gj  = 1.  Using  (11),  we  add 
© ^2*^2  ® code,  obtaining 

0(0  1 0 1 0 1 0 1)  © (0  0 1 1 0 0 1 1)  © (0  0 0 0 1 1 1 1)  © (1  10  0 10  1 1) 

= (11110111)=  (mg,  mj,  m^)  . 


Finally,  by  (14) 


7 

g«  = 1 , since,  n.  = 7 > 1 

” i=0  ‘ 

Although  IS  none  other  than  an  example  of  a set  of  one-error-correcting  and  two- 
error-detecting  codes  of  the  type  described  by  Hamming  in  Ref.  1,  the  method  of  decoding  con- 
sidered above  is  different.  Our  procedure  of  decoding  is  advantageous  in  that  it  may  be  gener- 
alized in  a natural  way  to  include  any  of  the  coding  spaces  of  Sec.  11.  Before  we  consider 
this  generalization  by  further  examples,  let  us  note  a tabular  way  of  representing  the  redundancy 
relations  (12). 

If  the  digits  or  variables  of  each  relation  arc  connected  by  lines  for  each  of  the 
vectors  Xj,  x^,  Xj  as 

X|  = (U^^l  tf  l U 1 0 1) 


x^  (0  U 1 1001  i) 


(0  0 0 


(15) 


the  relations  of  (12)  become  almost  self-evident  by  their  simplicity  with  respect  to  order  and 
symmetry.  This  simplicity  makes  ,t  possible  to  discover  redundancy  relations  for  more 
general  spaces  without  resorting  to  an  algebr  aic  approach  similar  to  the  one  used  to  obtain 
(12). 

As  a second  example  of  our  decoding  procedure,  consider  the  coding  space 
introduced  in  the  latter  part  of  Sec.  HI.  Each  vector  of  this  space  has  the  form  of  (8),  where 
the  generating  vectors  are  Xp  x^,  Xj,  x^  and  I of  (9).  The  first-degree  redundancy  relations  may 
be  determined  in  a manner  similar  to  the  above  example  and  represented  in  a tabular  manner 
similar  to  (18)  as  follows: 

Xj  = (0'~'  1 d~'l  0~'l  0~'l  0^1  0'~'l  0^1  0^1) 

X-  = (o"lT^i~^ 1 1 o'  1 d^"7V^  1) 


Xj  = (d  0 d 0 11  1 1 d^ (T 0 d^'i  'i  1 "i) 


x^  = (0  0 0 0 0 0 0 (T  1 1 1 1 1 1 1 1) 
For  instance,  the  eight  independent  and  joint  relations  for  gj  are 


(16) 
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*1^^2i®^2i+l  (i  = 0>  1*  • • • • 


If  the  eight  values  of  the  redundancy  relations  for  g.  are  labeled  r. ,,  r.,,  . . , r.„  for  (j  = 1,  2,  3,  4), 

J j*  3^  3“ 

and  Sj  is  defined  by 

8 


then,  by  an  argument  similar  to  that  used  in  the  previous  example,  the  majority  decision  test 
for  gj  is  as  follows: 


g.  = 0 

*3 


0.  is  indeterminate 
®3 


if  0 $ S . < 4 

if  S = 2 
3 


if  4 $S.  $8  for  (j  = 1.2,  3,4) 


(17) 


we  first  add  the  determined  vectors  gjX^  to  the  leceived 


In  order  to  determine  g^, 

message,  assuming,  of  course,  that  no  g.  is  indeterminate,  and  we  are  left  with  the  zero-degree 
T 4 3 

polynomial  (p^,  possibly  corrupted  by  errors.  If  there  had  been  no  errors,  there  would  be 
sixteen  zero-degree  relations  which  g^  satisfies,  or 


m. 

3 


for  (j  = 0,  1.  2 15) 


where,  as  in  (14),  m^  are  the  digits  of  the  code  after  extraction  of  gj.  g^.  gj  and  g^.  Thus  g^ 
io  determined  by  the  majority  decision  test 


15 

g„  = 0 if  Z m < 8 , 

" i-0 

15 

= 1 if  Z m > 8 . (18) 

i=0 


For  the  above  example,  three  errors  may  be  made  in  code  and  the  correct  message 
obtains.  If  four  errors  are  made,  some  of  the  message  digits  are  indeterminate.  It  is  of  some 
interest  to  note  that,  for  some  cases  of  five  errors  in  the  code,  the  message  may  be  extracted 
correctly.  For  example,  suppose  that  the  message  was  (0  0 0 0 0)  and  that  the  received  code 
was  (I  10010101000000  0).  Clearly,  the  correct  message  will  be  extracted  from  this 
code  by  the  above  procedure. 

As  a final  example  of  coding  and  decoding  scheme,  consider  This  space  is 

generated  by  Xj,  x^.  Xj,  x^  of  (16)  and  1,  as  well  as  the  quadratic  variables  x jX^.  ^jXj,  XjX^,x^Xj, 
x^x^,  x^x^.  The  latter  six  vectors  may  be  presented  in  the  following  tabular  manner: 
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XjX^  = (o"V^ I o'^ d 0^  1 d^o  1) 

XjXj  = (d'*'bdoold^i  0^  i ~d^ i ) 


XjX^  =(0  00000000101010  1) 

x^Xj  = (0  o'  0 T)  1 CT  (f  0^^  ' 1) 


X^X^  =(0000000000110011) 


XjX^  = (0  0 0 0 0 0 0 0 0 0 0 0'  1 1 11) 


(19) 


The  messages  for  this  example  will  be  1 1 binary  digit  numbers  of  the  form  (g^,  gj,  g^.  g^.  g^. 
®13’  ®14‘  ®24’  ^34^'  code  will  be  sent  as  a vector  of  the  form. 

go  ® gi’‘i  ® ® ® 64X4  © gj^XjX^  © gijXjXj  © gj4XjX^  © g^jX^Xj 

© Bz4^z^4  © g34’^3’‘4  ' 


I'he  secotid -degree  coefficients  g^^  of  the  received  message  are  extracted  first  with 
a majority  decision  based  on  the  redundancy  relations  illustrated  in  (19).  Next,  assuming  that 
no  indeterminacy  occurred  in  the  second-degree  coefficients,  the  vectors  gjj’^j^j  tidded  to 
the  received  code,  after  which  we  are  left  with  a residual  code  from  which  the  first-degree 
coefficients  g|.g2>g3>g4  tTioy  be  extracted  by  test  (I'?).  Finally,  the  zero-degree  coefficient 
gp  may  be  determined  by  test  (18)  after  adding  the  vector  g | x j , g^^^’  g3’‘3'  g4’^4  *0  the  residual 
code. 


This  example  illustrates  the  general  principle  of  decoding  the  particular  class  of 
ctxlcs  under  consideration.  The  highest  degree  coefficients  of  a received  code  are  extracted 
first;  then  these  terms  of  the  polynomial  are  subtracted  out  of  the  code,  thereby  leaving  a 
residual  code  of  the  next  lower  degree  than  the  original  code  in  the  special  car.e  of  no  errors. 

The  operation  is  repeated  over  and  over  on  the  successive  residual  codes  until  either  an  indeter- 
minacy occurs  or  until  gp  is  extracted. 

The  relations  of  (19)  illustrate  the  fact  that  there  are  four  redundancy  relations 
each  of  four  variables  for  the  second-degree  coefficients  g.^.  For  example,  the  redundancy 
relations  for  gj^ 

«12  = ^4i  ®^4iM  ®^4i+2®^4i  + 3 


In  general,  these  relations  will  allow  only  one  error;  two  errors  will  lead  to  indeterminacy. 
This  is  another  example  of  Hamming's  one-error-correction  and  two-error-detection  codes. 

It  should  be  noted  that  the  majority  decision  tests  used  in  the  above  examples  were, 
in  general,  overdeterminate.  For  instance,  in  the  first  example,  if  one  error  had  been  made, 
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no  more  than  one  error  would  remain  in  the  residual  code  after  determining  gj,  g^,  gj.  On  the 
other  tiand,  if  two  errors  had  occurred,  the  process  of  extraction  would  have  ended  before 
could  be  determined.  Thus  a test  of  only  the  following  type  would  be  necessary: 

go  = 0 if  m.j  + m-2  + m.^  $ 1 
gj  = 1 if  m.,  + m-2  + m-3^  2 . 

whri  c ij,  ij  are  any  three  distinct  numbers  between  zero  and  seven,  inclusive.  Refinements 
such,  a.-i  this,  however,  do  not  destroy  the  validity  of  the  previous  tests. 


V.  T HE  GENERAL  DECODING  PRINCIPLE 

To  study  the  general  decoding  scheme,  illustrated  by  example  in  Sec.  IV,  it  will  be 

nt'cessary  to  consider  the  general  multinomial  expansion  formula  (6)  more  carefully.  Let  us 

first  define  the  multiple  differences,  used  in  (6),  in  more  detail. 

As  in  lb),  f(i , , . . . i ) is  defined  as 
' ' '1  m 


f(i 


. . i ) " f when  i = 
m'  j 


m 

Z 

k-  1 


a*"-'  for  (1,  = 0,  1) 


(21) 


rtie  general  multiple  partial  difference 
P 

A f(i  , i , , . . . i ) 

k k k ‘ ^ 

'^r  ‘‘2’  • • p 

is  defitu'd  inductively  as 


A f(ii ij^^)  - f(i, *k-  1’  ‘k  ® ‘k+1 *m^  ® r • • • *k’  • • • ‘m^ 

K 


k,k^....kp  kj  ...kp_j  p-1  p pU 

P-1 

♦ A • 

Ki.  . . . Kp_i 


(22) 


With  these  definitions  it  is  possible  to  prove  by  induction  the  validity  and  uniqueness  of  expansion 
(6)  for  any  Boolean  algebra  of  m variables  and,  in  particular,  for  the  Boolean  algebra  of  2*^ 
dimensional  vectors  as  described  in  Sec  II. 

One  evident  consequence  of  (21)  is  the  identity 


f(il. 


*k-l  ‘k  ® ‘k+1’  • • • *m^  ^ ^+(-l)‘k 


(23) 


By  the  use  of  (23)  it  is  possible  to  write  (22)  explicitly  in  terms  of  the  f^  as 
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and 


where 


A f(ij,  • • • ^ ® ^+(-  1)  ‘k  2*^’  ^ 


P 

A 

kj,  k^.  . . . kp 


2P-I 


?P-1 


f(i,.  . . . i )=  E f.  © 2 f.  i. 

1 m'  , J.-  , J. . , 1 » k , p 


i=l  i=l  ^i+(-l)  2 


P-1 

A 


2P‘*  i k -1 

E f.  and  j j +(-\)  p 2 P 
k k k * ^ i-  1 Ji  IS 

K1.K2 Kp  j 1-1  I 

for  (i,  s = 1,  . . . 2P”  * ) 


(24) 


We  are  now  in  a position  to  prove  the  following  fundamental  theorem  on  which  the  general 
decoding  principle  of  the  class  of  codes  under  consideration  rests. 

Theorem  B:  — Each  highest  or  r-<h  degree  coefficient  of  any  vector  or  polynomial  f of 
satisfies  exactly  2^  disjoint  relations  where  each  relation  has  precisely  the  form 

2'- 

£ f- 
k=l  k 

where  i^^  are  distinct  numbers  from  the  set  (0,  1,2,...  2"’  - 1)  for  (k  = 1,2,...  2^).  Disjointness 

of  relations  means  that  no  two  relations  have  variables  f in  common. 

1 

Proof:  — Choose  m and  r.  By  (6),  (7)  and  (24),  the  highest  degree  coefficients  for  an  f of 


g.  k = ^ f(0,  ...0)  = E f 

r ■ ' r k,k-.  . . k i=  1 -li 

12  r 


(25) 


where  k.  are  distinct  integers  from  the  set  (1,2,...  m)  for  (j  = 1,  . . . r),  and  j.  are  distinct 

J m r ^ 

integers  from  the  set  (0,  1,  ...  2 - 1)  for  (i  = 1,  2,  ...  2 ).  Moreover, 


k J — k^OjO^.  . . n^ 


f(0,  . . . 0)  = 0 


(26) 


for  t > 1,  and  k^  and  .n.  are  distinct  integers  from  the  set  (1,  2,  . . . m)  for  (j  = 1,  . . .t). 

Let  k J,  k^.  . . k^  be  a distinct  set  of  integers  from  the  set  (1,2,...  m).  Then,  by 
(26)  and  (22), 

r+ 1 r r 

A f(0,  ...0)=  A f(0,  ...0)©  A f(0,  . . . 1,  . . . 0)  = 0 . (27) 


k , . . . k n , 
I r 1 


kj.  ..k^ 


k , . . . k 
1 r 


where  Hj  is  any  one  of  the  m - r integers  from  the  set  (1,  2,  . , ,m)  which  is  distinct  from  the 
integers  (kj,  k^, . • . k^.).  Thus,  by  (24)  and  (25),  we  have  exhibited  m - r new  relations  of  the 
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form  required  by  the  theorem.  Each  of  these  new  relations  is  distinguished  by  the  fact  that  the 
digit  one  appears  only  in  the  nj-th  position  of  the  function  f(i^i . . operated  on  by 

r 


A 


Now  define  f[i.j,  n2- . . . n J to  be  f(ij,  i2>  ••  • with  ij^  = 1 for  k = Oj.  02,...  n^  and 
i|^  = 0 otherwise.  The  theorem  will  be  proved  by  induction  on  the  subscript  of  n.  Assume 
therefore  that 


r+s  - 1 
A 

. . . k n.n 
r 1 


f(0.  0 0) 


2 S-  1 


r 

A 

k , . . . k 
1 r 


f(0.  0.  ...  0) 


r 


(28) 


Now,  by  (22)  and  (26)  and  the  induction  hypothesis  (28) 

f(0.  0 0)  = A 


r+s 

A 


r+s-  1 
A 


f(0,  0 0) 


k,...krnj,..n^ 


ns\k,...k^n,...n^^_, 


= A ( A f(0,...0)©  A f[nj,  . . . n^j] 
n^\^k,...k^  k,...k^ 

r r 

A f(0,  0....0)©  A f[n.....n  ,1 

kj,...k^  k,...k^ 

r r 

© A f [n  ] © A f [n , , . . . n 1 = 0 

. S • t 1 3 


k,.  . . k 
1 r 


kj.-.k^ 


Now,  by  (27)  and  (28),  the  two  middle  terms  are  equal  to 
r 

A f(0,  0 0)  , 


and  therefore  their  sum  modulo  2 is  zero.  Hence 

r+s  r r 

A f(0,  ...0)=  A f(0,  ...0)©  A _ f[nj,  , . . n^]  = 0 , 


and  the  induction  is  complete.  The  theorem  is  proved  when  we  observe  that  the  relation 
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r+s 


A f(0,  . . . 0)  = 0 contributes 


k, . . . n 

1 s 


(-;■). 


distinct  relations 


A f(0,.,.0)=  A f[n,,n,...n  ] , 

1.  1-  »-  A S 


k , . . . k 
1 r 


since  there  are 


r;) 


ways  of  choosing  s integers  from  m - r integers.  Using  all  the 


relations  (26)  for  the  particular  set  kj.  ••k^,  and  t=ltot=m-r  and  the  relation  (25),  we  get 


m - r / m - r 


1 + z 

t=  1 


distinct  relations  for  g.  i,  • Since  these  relations  exhaust  all  variables  f.  , the 

theorem  is  proved. 

The  above  theorem  shows  that  the  generalization  of  the  decoding  principle,  discussed 
in  the  last  section,  obtains.  The  majority  decision  test  for  the  general  case  can  clearly  be  used 
to  extract  the  r-th  degree  coefficients  of  l|^  , where  the  relations  used  for  the  test  are  the  2*^  ^ 
relations  of  Theorem  B.  The  (r  - l)-th  degree  coefficients  are  then  extracted  the  same  way 
after  the  determined  r-th  order  terms  have  been  subtracted  or  added  into  the  received  code. 

This  process  is  continued  for  the  r - 2,  r - 3,  . . . degree  coefficients  until  the  message  is 
extracted  or  an  indeterminacy  is  reached. 

VI.  CONCLUSIONS 

There  are  two  or  three  generalizations  of  the  codes  and  the  methods  of  decoding.  In 
Ref.  2,  Muller  discusses  a possible  set  of  codes  other  than  binary  length  of  2^.  Another  gener- 
alization obtains  where  the  polynomials  are  considered  over  a field  other  than  characteristic 
two;  i.e.,  ternary  codes,  etc.  Lastly,  it  appears  from  some  work  of  T.  A.  Kalin  that  an  error- 
correction  scheme  of  the  type  considered  by  Hamming  may  generalize  to  the  coding  space 
in  a rather  natural  way. 
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